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ABSTRACT 

Given  N  regions  with  their  associated  conditional  detection  probabilities 
ttj,  . . . ,  0^,  let  player  A  choose  one  region  to  hide  in,  and  let  player  B  look 

in  one  region  at  a  time  until  he  finds  A.  The  payoff,  to  player  A,  is  the  ex¬ 
pected  number  of  looks  required  of  B  to  find  A .  The  form  of  the  optimal  pure 
strategies  for  B  is  described,  and  the  mixed  extension  of  this  game  is  shown  to 
have  a  solution.  Player  B  has  a  good  strategy  that  is  a  mixture  of  at  most  N 
pure  strategies.  A  numerical  procedure  for  calculating  the  solution  is  given. 
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A  2 -PLAYER  N-REGION  SEARCH  GAME 


Stq>pose  that  player  A  can  hide  in  any  one  of  N  regions,  and  that  player  B 
searches  until  he  finds  A.  The  probability  that  B  can  detect  A  in  region  i, 
given  that  A  is  there,  is  ,  and  0  <  a  ^  <  1,  i  =  1 . N.  The  are  known 

to  bodi  A  and  B.  Player  A  chooses  a  region  to  hide  in  and  stays  there.  Player 
B  then  looks  in  one  region  at  a  time  until  he  finds.A.  The  payoff  is  to  player  A; 
it  is  the  expected  number  of  looks  that  B  must  make  until  he  finds  A. 

The  class  of  pure  strategies  for  B  is  the  collection  all  sequences 

y  =  |yj,  y^ . y^  ,  ...  |  in  which  each  y^  is  either  1,  or  2,  or  ... ,  or  N. 

Given  such  a  sequence,  B  looks  first  in  the  region  indicated  by  y^,  then  in  the 

region  indicated  by  y,,  etc. ,  until  he  finds  A. 

The  set  of  A's  pure  strategies  is  the  set  |l,  2,  ....  N  j  ;  he  chooses  an 

integer  i  and  hides  in  region  i  until  he  is  found  by  B. 

For  each  1  and  each  y,  let  M(i,y)  denote  the  payoff  to  A.  This  is  the 

expected  number  of  looks  required  of  B  to  find  A.  If  y  =  |  y^,  yj,  . . .  | ,  we 

shall  call  the  first  k  elements,  y^ . ^k  ^  ^  segment  of  y,  k  arbitrary. 

Its  length  is  k.  We  define,  for  each  y,  and  for  each  i,  j,  isisN,  l^j<*, 

Cjj(y)  =  the  lengdi  of  the  smallest  segment  of  y  containing  J  i*s, 

if  diere  is  such  a  segment,  and 

Cij(y)=  +• 

if  no  segment  contains  j  i's  . 

For  example,  suppose  N  -  4,  and 

y  ~  "1^2,  1,  3,  2,  4,  2,  4,  3,  3,  4,  1,  2,  1,  4,  3,  2,  ...  . 

Then,  for  j  =  1,  2,  3,  ....  we  have 

J  ^  2^  •  •  •  f 

^2J  *  ***’ 

Cgj  »  3,  8,  9,  15 . 

*'4J  *  •  • 
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We  have,  evidently,  for  each  i  and  each  y, 

QD 

M(i,  y)=  L  c  (y)  a  (1  -  o  .  (1) 

J=1  *  * 

(The  sum  of  the  series  may  be  +  ®  . ) 

If,  in  the  long  run,  player  A  hides  in  region  i  with  probability  i  , 

N  c  * 

2^  C  j  =  1,  we  denote  the  expected  value  of  M  (i,  y),  for  fixed  y,  by  M(  ^  ,  y). 

1 

We  have 

N 

M(e.  y)=  E  M(i.  y)  . 
i=l  ‘ 

(Of  course,  0  •  *  is  defined  by  0  •  *  =  0. ) 

We  shall  begin  by  showing  that  for  each  probability  vector  (^ ^ . 

a  mixed  strategy  for  A,  there  is  at  least  one  optimal  y  ((  ),  i.e.,  a  pure 
strategy  for  B  such  that 

MiC,  y(e  ))s  M(e.  y) 

for  all  y.  Let  us  first  observe  tiiat  for  each  y,  the  set  of  finite  values  of 
c  j  j(y)  for  i  »  1 . N,  j  =  1,  2,  . . .  is  die  set  of  all  positive  integers,  no 

two  finite  c.j(y)  are  die  same,  and  .  Conversely,  If 

{  Yj  j  }  is  a  set  of  positive  integers  having  the  previous  three  properties,  then 
there  is  a  y  such  that 

^ij  “ 

i  *  1,  . . . ,  N;  J  =  1,  2,  . . .  .  In  our  example  above,  the  knowledge  of  all  the 
^i  j  ®***^^®®  ^*8  reconstruct  the  strategy  y;  from  c ^  j  we  see  that  we  must 

look  in  region  1  on  the  2^^,  11—,  13^,  . . .  looks,  in  region  2  on  die  1—,  4^ 

6—,  . . . ,  looks,  etc.  Tills  remark  will  be  useful  later. 
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For  each  y,  we  now  have 
N  " 

M(e,y)=  L  L  c.Ay)  (2) 

1=1  J=1  ‘J  ‘  ‘  * 


Since  the  c 


ij 


*8  run  liirous^  all  the  positive  integers,  we  can  write 


M  (  ^  ,  y)  =  E  V  w  (y)  +  E  ®  *  f , ,  (y) 
v*l  ^  i  ,  J 


(3) 


in  which  the  are  weij^ts  from  the  set  of  all  numbers  ^  |  ~  ^  ^  * 

for  Miich  c^^  is  finite,  i  =  1,  . . . ,  N;  J  =  1,  2,  ...  ,  and  C  ^  j  runs  through 
the  Oj  (1  -  ttj)  ^  ^  for  which  Cj j  “  *  •  '*  *  ^i j 

‘^v^y^=  ^jaj(l-aj)^  ^.)  We  have  E  <„^(y)  +  Z  =  1  .  Furthermore, 
if  y*  is  another  strategy,  then  cj^(y')  and  (y*)  are  ol^ined  simply  by 

rearranging  the  weights  j  C  a  (1  -  a .  )^  .  The  optimal  y(  ^ )  can  now  be 

described  very  easily.  We  need  only  recall  that  if  (  v )  j  is  a  collection 
of  (cumulative)  distribution  functions  on  the  positive  v  -  axis,  with  F  (0)  =  0, 

€D  y 

F  (  ®  )  =  1,  and  if  for  some  y,  v  ( 

^  5 

OD 


I  d  Fy(  V )  <  • ,  then 


E(  v)=  J  V  dF  (v) 


“  -I  vd[l-P(v)] 


-  I  [>-F/v)]<lv 
0 
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00 

(since  v  |^1  -  F^(  vd(l-  Fy(  v)  )—  0  as  v  —  •  ). 

V 

Therefore,  if  for  some  jTq  ,  we  have 


F.  (v)  i  F  (v) 


for  all  V  and  for  all  y,  then 


J  V  d  F^  (  v)  is  the  minimum  with  respect 
n 


to  y.  In  our  situation,  we  take,  for  each  y,  F  (  v-)  =  23  ^  (v)  for  each  v 

y  ^  v=l 


(Note:  There  is  a  y  for  which  E(  v)  <  ®  ,  e.g. ,  y  =  (1,  2,  . . . ,  N,  1,  2,  ... 

N,  , . . ,  1,  2,  ...  N,  ...).)  Then  an  optimal  y  =  y(  ^  )  is  obtained  by  taking 

Uj  to  be  the  largest  of  .  a.(l  -  a.)^  '**^2  largest,  etc.  In  case 

there  are  two  or  more  weigjits  remaining  that  are  equal,  we  can  choose  any  of 
them  for  the  next  .  We  shall  refer  to  such  a  situation  as  a  "tie".  When 

the  at^’s  have  been  determined,  our  optimal  policy  is  also.  We  summarize 

the  result  in  the  following: 

Lemma  1:  If(^. . C^^isa  mixed  strategy  for  A,  then  an  optimal 

pure  strategy  y  =  y(v  )  for  B  can  be  obtained  as  follows:  Take  all  the  numbers 
0:^(1  -  Cf.)^  i  =  l,  ...,  N;  j  =  l,  2,  ...  and  order  them  in  a  decreasing 

sequence,  |  .  If  o  .(1  -  a . )  ^"^  ,  then  the  v—  look  must  be  in 

region  i. 

In  the  following,  we  shall  restrict  player  B  to  those  pure  strategies  y  for 
which 


M(i,  y)  <  * , 

i  ®  1,  ....  N.  We  shall  see  that  in  the  mixed  extension  of  our  game,  this  is 
no  real  restriction  on  B. 

Let  us  now  proceed  to  the  mixed  extension  of  our  game.  The  mixed 
strategies  for  A  are  the  probability  vectors  (  . ^  ’ 

N 

^  0  ,  ^  V  s  1.  'The  class  of  mixed  strategies  for  B  is  the  collection 

'  1=1  ‘ 
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of  all  functions  17  -  17(7)  defined  on  the  set  of  pure  strategies  y  for  B,  such 
that  V(y)-0  except  for  finitely  many  y's,  ^  ^(y)  »  1  (i.e. ,  B  is  allowed  to 

y 

mix  over  any  finite  number  of  y's).  Such  a  game,  in  vdiich  player  A  has  a 
finite  number  of  ^e  strategies,  is  called  an  S-game,  cf.  [l]  .  The  payoff 
is  denoted  by  M(C  ,  )  • 

N 

M(  f ,  ^  )  =  £  E  ^  «  ’I  (y)  M(i,  y). 

i=l  y 

The  relevant  theorem  in  this  situation  is  as  follows  [l;  49^  : 

Theorem  1:  Every  S-game  has  a  value  v.  Player  A  has  a  good  strategy 
C*  ,  i.e.. 


V  <  M(f*,  y) 


for  every  y.  For  every  e  >  0  ,  there  is  an  t)  such  that 


M(i,  ‘»7  )  <  V  +  €  , 

i  =  1,  2 . N  (where  M(i,  17  )  =  £  r)(y)  M(i,  y)). 

y 

That  an  S-game  always  has  a  value  v  means  that 

inf  sup  ,  7j  )  =  sup  inf  M(^  ,  17  )  =  v  . 

V  ^  i  V 

The  main  task  remaining  before  us  is  to  prove  that  player  B  has  a  good  strategy. 
The  theorem  tells  us  only  Aat  B  has  an  ”e-good"  strategy  for  every  e  >  0. 

The  discussion  of  S-games  is  based  on  the  following  construction.  For 
each  y,  let  8(y)  be  the  point  in  R_(real  N-space)  with  coordinates  M(i,  y), 
i»l,  ....  N:  ^ 
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8(y)  = 


M(l,  y) 


M(N,  Y) 


Let  S  denote  the  set  of  all  s(y)'s  in  Rj^  .  Let  S*  denote  the  convex  hull  of 

S,  i.e. ,  the  set  of  all  finite  convex  combinations  of  points  in  S  . 

For  any  two  vectors  {  and  u  in  Rj^  ,  we  write  the  inner  product  of  C  and 
u  thus: 


N 

(C ,  u)  =  f  i  u  . 

i=l  ‘  ' 

Now,  if  7^  is  a  mixed  strategy  for  B,  then  2^  V  (y)  s(y)  belongs  to  S*. 

y 

Conversely,  if  u  is  in  S*,  then  there  is  an  17  =  ij  (y)  such  that  u  =  2^  V(y)  siy). 

y 

It  follows  that  our  S-game  is  equivalent  to  the  following:  player  A  chooses  a 
probability  vector  C  >  player  B  chooses  a  point  u  in  S*,  and  the  payoff  is 


M  =  ( ^  ,  u)  . 

Let  us  note  that  in  our  case  the  set  S,  therefore  also  S*,  lies  in  the  positive 
orthant  of  Rj^  --  all  points  have  positive  coordinates. 

We  shall  briefly  sketch  one  way  to  prove  Theorem  1.  Define,  for  each 
real  y  ,  the  open  orthant 

ju  :  Uj  <  Y  ,  i  =  1,  2,  . . .  N  I  . 
sup  {y  :  T^  n  S*  =  0  ].  . 
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Then,  if  we  write  C1(E)  for  the  closure  of  any  set  E  in  Rj^  ,  we  have 


CKT^  *)  n  C1(S*)  f  0  . 

Let  u*  e  CKT^  *)  n  C1(S*)  .  Let 
(  £  *  .  u)  =  V 

N 

be  the  equation  of  a  hyperplane  separating  T  *  and  S*,  with  ^*  =  1. 

^  i=l  ‘ 

Then 

a)  ^  i  0,  i  =  1 . N  , 

b)  (  C*,  u*)  =  V  , 

c)  (  C*.  u)  2  V  for  all  u  in  S*  , 

d)  (  C*.  u)  i  V  for  all  u  in  T  * 

Y 

e)  Y  *  =  V  . 

f)  max  u*.  =  V  . 

1  Si  s  N  ‘ 

g)  For  each  i,  isisN  either^*.  =  0  or  else  u*.  =  v. 

®  1  i 


Once  these  facts  have  been  established,  we  set 


V,  =  sup  inf  (^  ,  u)  , 
^  ^  u  e  S* 


V,,  =  inf  sup  (^  ,  u)  , 

^  ueS*  ^ 

in  vdiich  C  ranges  throug^i  the  set  of  probability  vectors.  Then  v^  ^  v^  , 
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of  course.  Now 

V,  ^  inf  (C  ,  u)  for  all  C  . 

^  ucS* 

Therefore 

V,  i  inf  ((  •,  u)  . 

^  u  c  S* 

Since  u*  is  a  limit  point  of  S*  ,  we  have  from  c)  and  b)  above, 

Vl  ^  V  .  (3) 


Also, 


V  y  s  sup  (  ^  ,  u)  for  all  u  in  S*  ; 
therefore 


V,,  ^  max  u.  for  all  u  in  S*  , 
^  1  sisN  ‘ 


and  since  u*  e  C1(S*),  we  have  also 

V,,  s  max  u*  =  V  (4) 

^  1  sisN  ‘ 

by  f).  Now  (3)  and  (4)  show  that  ^  * 

Then(  *  is  a  good  strategy  for  A,  using  c).  Also,  if  e  >  0,  there  is  a  u  in 
S*  such  that 
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for  i  >  1,  ....  N,  so  that 

Uj  <  V  +  €  ; 

u  is  of  the  form 

u= 

y 

for  some  V  ,  and  V  is  an  "e-good"  strategy.  This  completes  the  proof  of 
Theorem  1. 

We  shall  prove  diat  u*  belongs  to  S*  ;  then  u*  will  be  a  convex  combination 

u*  =  E  *  (y)  8(y) 
y 

of  points  in  S,  and  V  *  will  be  a  good  strategy  for  B.  First  we  require  two 
more  lemmas. 

Lemma  2:  Let  be  a  boundary  point  of  S*,  and  suppose  there  is  a 

sequence"^)^)  |  in  S  converging  to  u°.  Let  (f  ,  u)  =  y  .  with 

N  ^ 

2]  ^  =  1,  be  the  equation  of  a  suiqx>rting  hyperplane  through  u  .  Then 

i=l  ' 

f  j  >  0  for  i  ■  1 . N,  and  there  is  a  y^  such  that  u°  =  8(y°),  i.  e. ,  u°  e  S  . 

Proof:  It  is  clear,  in  the  first  place,  that^  ^  ^0,  i  =  1 . N,  since  if, 

for  example,  C  ^  <  0,  then  by  taking  a  sequence  of  pure  strategies  y*^  in  which 
player  B  looks  less  and  less  frequently  in  region  1,  we  will  have 

iC  ,  s(y“) )  —  -  * , 

contradicting 

(^  ,  u)  ^  Y  *  0  for  all  u  in  S*  . 
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Let  u°  have  coordinates  .  Since  8(7^^)— u°,  we  have,  If  c  >  0  , 
00 

M(i,  Y^)  =  ~  ^  <  u°j  +  €  , 

i  «  1,  ....  N,  for  all  n  large  enough.  Therefore,  for  each  i  and  j. 


0<  Cjj(yjj)<  (u°|+  «)  /  ttjd  -  Oj) 


J-1 


for  all  n  large  enough,  i.e.,  for  fixed  i,  J,  the  sequence  {cjj(y^)  }  is  bounded. 

Therefore,  for  a  subsequence  of  |y^  | ,  CjjCy^^)  converges;  for  a  subsequence 
of  the  latter,  C2j(yjj)  converges,  etc.,  and  by  the  "diagonal"  procedure,  we 

obtain  a  subsequence,  call  it  |y^  j-  again,  for  vdiich  Cj  ^Y^  converges  for 


every  ij  .  Let 


lim 


c.i<yj  =  Y,,. 


iJ 


i  =  1,  . . . ,  N ;  j  =  1,  2 . It  is  clear  that  for  each  i,  J,  Yj j  is  a  positive 

integer,  all  the  Yjj  are  distinct,  and  Yjj  <  Yj|^  if  j<k.  Also,  every 
integer  v  appears  among  the  y^ j  •  Indeed,  for  each  n,  the  number  v  must 
ai^)ear  somewhere  among  the  vN  numbers  c  jj(y^)  ,  i  =  1,  . . .,  N;  J  =  1, 

. . .,  V.  Since  we  have  Cjj(yj^)  =  Yjj  for  all  n  large  enough  for  i  =  1,  . . .,  N, 

J  =  1,  . . .,  V  ,  it  follows  that  V  is  equal  to  some  Yj j  . 

From  our  previous  remarks  (before  Lemma  1),  we  see  that  {yj j  ]•  comes 
from  some  pure  strategy  y^  , 


^ij  *  * 
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For  each  integer  q,  we  have 
lim 


q 

L 

J=i 


Yijo^d-ai) 


J-1 


Therefore, 


a» 

L 

J=i 


VijOid  -  Cl) 


J-1 


(5) 


i  =  1 . N,  or 

M(l.  y°)  s  .  (6) 

It  follows,  since  ^  j  ^ 

,  s(y°))  s  (^  ,  u°)  =  Y  . 
and  therefore 

(C  ,  S(y°))  =  Y  (7) 

(because  (^  ,  u)  ^  Y  for  u  in  S*).  This  means  that  y°  is  optimal  against  t  , 
and  from  Lemma  I,  we  see  that  every  C  j  ^  indeed,  if  C  ^  »  0,  say,  then 

the  optimal  strategy  y^  would  require  no  looks  in  region  1,  contradicting 

M(l,  y°)  <«.  Buttf£^>0  for  i  =  1,  . . N,  then  we  must  have  had 

equality  in  (6)  for  i  -  1,  . . . ,  N  in  order  for  (7)  to  be  valid.  This  means  that 

8(y°)  =  u®  and  die  proof  is  complete. 

Lemma  3:  Let  E  be  a  closed  convex  subset  of  R^  lying  in  the  positive 

orthant  (all  coordinates  U|  of  u  in  E  are  non-negative).  Then  E  contains  an 

extreme  point. 
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Proof;  Let 

^ (u)  ®  Uj  +  •  •  .  +  Ujq  > 


and  let 


c  *  inf  i^(u)  . 
u  e  E 


TTie  set 


G  *  {u  e  E:  c  «  ^(u) 


<  ^  1 


1 


is  closed,  bounded,  and  non-empty.  Therefore  there  is  a  in  G  for  which 
^(u°)  =  c. 

Let 

H  =  |u  c  E :  ^  (u)  =  c  j-  . 


Then  H  is  non-empty,  closed,  bounded,  and  convex.  Therefore  H  contains 
an  extreme  point  u*.  This  point  u*  is  also  an  extreme  point  of  E.  (If 

u*  =  (u^  +u)/2  with  u^,  u^  in  E,  then  <^(u*)  -  ('I'  (u^)  +  <jf(u^))/2  =  c; 

12  12 
since  ^  (u  )  ^  c  and  ^  (u  )  ^  c,  we  have  ^  (u  )  =  ^(u  )  =  c,  u,  ,  u- 

belong  to  H.) 

Theorem  2:  S*  is  closed. 

Proof:  Let  u^  be  a  boundary  point  of  S*,  and  let 


((  ,  u)  =  Y 

o  ^ 

be  die  equation  of  a  supporting  hyperplane  through  u  with  iC  ^ 

i=l 

Then 


1. 


((  ,  u)  »  Y 

for  all  u  in  S*,  and  ^  ^  ^  0,  i  >  1,  . . . ,  N,  as  indicated  in  die  proof  of  Lemma  1. 
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and  set 


E  =  J  n  CI(S*)  . 


Since  E  is  closed  and  convex,  and  lies  in  the  positive  oithant  of  R., ,  E 

#  # 

contains  an  extreme  point  u  ,  by  Lemma  3.  Then  u  must  also  be  an  extreme 
point  of  Cl (S*). 

Now  every  u  in  S*  is  a  convex  combination  of  at  most  N  +  1  points  of 
S  [l,  36  ]  : 


N 

u=  L 

J=0 


At  least  one  of  the  X  must  be  ^  1 

J  N+ 1 

together,  we  can  write,  for  every  u  in  S* 


If  we  lump  the  remaining  s 


j 


u  =  os+(l  -a)v 

with  s  in  S,  V  in  S*,  1/(N  +  1)  s  a  s  1.  Now  let  u**— -  u  , 

u“  =  s“  +(1  -  a^)  v“,  (8) 

s"  in  S,  v“  in  S*.  1/(N  +  1)  s  Oj  ^  1  • 

It  follows  that  on  the  line  joining  s°  and  v",  diere  is  a  point  w*^  such  that 

u“  =  s"/(N  +  1)  +  N  w“/(N  +  1)  ,  (9) 

8°  in  S,  w*^  in  S*.  Let 


e 


JL 


^ i»  i»  •  •  • , 


1)  . 
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Since  u  ,  we  have 

(e.  u")  =  <e.  s")  /  (N  +  1)  +  N  (e.  w")  /  (N  +  1)— (e,  u*). 

Since  s"  and  have  positive  coordinates,  it  follows  that  (e,  s°)  is  bounded; 
so  is  |s"  I  .  Therefore,  a  subsequence  converges  and  we  may  suppose 

8-^8  ;  by  (9),  w  — -  w  , 

u*  =  s*  /  (N  +  1)  +  N  w*  /  (N  +  1)  . 

Since  u  is  an  extreme  point  of  01(8*),  we  have 

#  #  « 

u  =  s  *  w  , 

it  it 

i.e. ,  u  =  lim  s  ,  s“  in  S.  By  Lemma  2,  we  conclude  that  u  =  8(y°)  for  some 

o  ^  it  o 

y  .  and  that  the  hyperplane  through  u  ,  passing  also  through  our  original  u”, 

whose  equation  was 

J:  ({  ,  u)  =  Y  , 

must  be  such  that  >  0  for  i  =  1,  ....  N.  From  this,  we  see  that  our  set 
E  n  C1(S*)  is  bounded  as  well  as  closed. 

We,  have  shown  that  every  extreme  point  of  E  belongs  to  S.  Since  E  is 
compact,  E  is  generated  by  its  extreme  points.  Therefore  our  original  bound¬ 
ary  point  u^,  \^ich  belongs  to  E,  is  a  convex  combination  of  extreme  points  of 

o  it 

E,  i.e. ,  of  points  of  S,  so  that  u  e  S  .  The  proof  is  now  complete. 

Cyollary  The  mixed  extension  of  the  original  game  between  A  and  B  in 
which  B  can  mix  over  all  of  his  pure  strategies  (even  if  M(i,  y)  *  for  some 
i)  has  a  solution;  it  coincides  with  the  solution  of  the  modified  game  (M(i,  y)  <  *, 

i  «  1,  . . . ,  N).  Player  B  has  a  good  strategy  h  *  that  is  a  mixture  over  at  most 

N  pure  strategies.  We  have  ^  V*(y)  M(i,  y)  =  v,  i  »  1,  2,  . . . ,  N. 
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Proof:  It  is  clear  from  the  preceding  that  if  c*  is  a  good  strategy  for  A 
(cf.  Theorem  1),  then  >  0,  i  =  1,  . . . ,  N.  We  have  seen  that  S*  is  closed, 

so  that  the  point  u*  e  C1(S*)  0  T  ,  described  in  the  discussion  of  Theorem  1, 
belongs  to  S*;  ^ 

u*  =  2^  V  *(y)  s(y) 

y 

for  some  rj  * .  We  have 

(^  .  u*)  sv  u)  (10) 


for  every  probability  vector  C  and  every  u  in  S*.  Since  ^  >  0  for  i  =  1 . 

N,  we  have  u*.  =  v  for  i  =  1 . N,  from  g)  (preceding  (3)),  i.e. , 

22v*(y)  M(i,  y)  =  V  , 

y 


i  s  1 . N.  Equation  (10)  implies  that 

vi(f*,  s(y))  (11) 

for  every  pure  strategy  y  for  which  s(y)  is  finite.  Since  ^ *.  >  0,  i  =  1,  . . . , 

N,  (11)  is  a  fortiori  true  if  y  is  a  pure  strategy  for  which  M(i,  y)  =  •  for  some  i. 

Since 

(C  *.  8(y))=v 

for  every  y  for  which  ■*)  *(y)  >  0  (otherwise  we*d  have  (  C  *,  u*)  >  v),  u*  is  a 
convex  combination  of  points  s(y)  of  S  lying  in  an  N  -  1  dimensional  space. 

Hence  ^1,  36  J  ,  u*  can  be  expressed  as  a  convex  combination  of  at  most  N  of 

these  s(y)'s,  and  the  proof  is  complete. 
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Let  I  denote  the  closed  simplex  of  all  probability  vectors  C  , 
N 

t,^o.  z;  f,-‘- 

‘  i»i 


Let 

F(0=  inf  (£  .  s(y))  .  (12) 

y 

By  Lemma  1,  there  is  a  y  that  is  optimal  against  i  ,  so  that  we  can  write 


F(f  )  =  min(^  ,  s(y))  =  (i  ,  s(y{C )))  , 

y 

in  which  y(  O  is  some  pure  strategy  optimal  against  C 

Theorem  3:  F  ( f)  is  concave  on  Z  , 

2°  F({  )  is  continuous  on  I , 

3°  max  F  (  C  )  =  V  , 
o 

4  F  (  c  )  achieves  its  maximum 


at  an  interior  point  of  (  . 

Proof:  By  (12),  F(  0  is  the  infimum  of  a  collection  of  linear  functions 

of  i  ,  all  bound^  below,  by  zero. 


3°  max  F (  C )  =  max  inf  {C  ,  u)  =  v  . 

^  f  u  c  S* 

4°  If  F(  ^  *)  =  max  F(C  ),  then 

( 

V  »  F(C  *)  » (  C  *,  y(  C  *)),  and  from  the  preceding  discussion  (e.g. ,  Lemma 
2)  ^*^>0,  i  =  1 . N. 
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2°  Since  P(C  )  ^  inf  (^  ,  8(y)).  bounded  below,  and  each  (t  ,  8(y)) 

is  continuous  In  c  ,  F(4  )  is  upper  semi -continuous.  Therefore,  vdienever 
we  have 

lim  F(f")  s  F(f°).  (13) 

n  OD 

Also,  F(  is  concave,  so  that  if  then  also  (X  **  +^°)/2— and 

F(  (^  "  +  ^  V2)  i  (F(^  “)  +  F(^  °))/2  . 

By  (13), 

F(^  )  i  lim“  F(l/2(^  “+  f°))  a  i/2lIi5"F(^“)  +  l/2F(^  °) 
o  n  — •  n— • 

so  that 

F(f  )s  Tinr  F(£“), 

°  n— 

and  by  (13), 

TIHr  F(f  “)  =  F(f  °)  . 
n— ® 

Since  this  is  true  for  every  sequence  converging  toC  we  have  UmF(^  }  = 
F(^  and  the  proof  is  complete. 

Theorem  4:  Let 

E  -  e  £:  y(^  )  is  not  unique  j-  . 

Then  E  is  a  countable  union  of  N  -  2  dimensional  flat  spaces  in  £  ;  in  particular 
E  has  (N  -  1  dimensional)Lebesgue  measure  zero. 
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Proof:  We  know  that  C  e  E  if  and  only  if  there  la  a  tie  somewhere 

after  we  have  arranged  the  weights  i  ^  0^(1  -  #  1*1.  ....  N;  J  ■  1, 

2,  ...  in  decreasing  order,  by  Lemma  1.  This  means  that  ^  e  E  if  and  (mly 
if  we  have 

^  j  ttjd  -  a^(l  - 

for  some  i,  J,  k,  m;  this  completes  the  proof. 

It  would  appear  plausible  from  this  fact  that  the  maximum  of  F  (  ^  ),  >^ich 

yields  the  value  of  the  game,  is  achieved  at  a  point  ^  *  for  which  y(^  )  is 
almost  certainly  unique  (so  that  player  B  has  a  good  pure  strategy)  but  we  have 
no  proof  of  this.  There  are  certainly  cases  for  which  player  B  has  no  good 
pure  strategy,  e.g. ,  if  the  detection  probabilities  a,  are  all  equal,  in  which 

#  ^ 
case,  we.  must  have  C  ^  =  ...  ~  ^  ~ 

To  compute  (approximately)  the  solution  to  a  particular  game  of  this  type, 
we  can  proceed  as  follows:  Find  as*  that  yields  the  maximum  of  F(  s  ). 

j^For  each  C  ,  we  know  how  to  find  an  optimal  y(C  );  then  F(^  )  =  (^  ,  s(y(C  ))). 

The  maximum  of  the  function  F  (  C  )  can  be  found  by  some  variant  of  the  steepest 

ascent  method.  I  Express  C  *  as  a  convex  combination  of  ^  1  =  1,  ....  N, 

i  J  ^ 

with  C  '•  close  to£  ,  e.g. ,  let 

C  ^  =  (1  -  €)C  •  +  €(0,  0  ..,  1^^,  0  ...,  0) 

with  e  small  and  positive.  Let  y^  be  a  pure  strategy  for  B,  optimal  against 

C  ^  .  Then  |s(y^)  | ,  j  =  1 . N,  will  approximately  "straddle"  the 

critical  point  u*  in  S*  .  Let 

Mjj  =  M(i.  yl), 

i,  ]  »  1,  2,  . . . ,  N.  Solve  the  N-rowed  matrix  game  with  entries  M^ ^  .  Let 
its  solution  be  ^  v°  .  Then  v°  is  an  upper  bound  for  v,  ^^is  an 

approximate  solution  for  B.  and  (  ^  and  ^  *  are  each  possiUe  mixed  strategies 
for  A.  Take  t  ^  or  C*,  vdilchever  yields  the  larger  F(^  ) . 
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